Stationary algorithmic probability
نویسنده
چکیده
Kolmogorov complexity and algorithmic probability quantify the randomness and universal a priori probability of finite binary strings. Nevertheless, they share the disadvantage of depending on the choice of the universal computer which is used as a reference computer to count the program lengths. In this paper, we propose an approach to algorithmic probability that tries to eliminate this machine-dependence. Elaborating on the idea that computers with “atypical” algorithmic probability should be hard to emulate, we define the notion of emulation complexity. This naturally leads to a Markov process of universal computers that randomly emulate each other, yielding stationary probability distributions on the computers and finite binary strings. By proving symmetry relations with respect to input and output transformations, we show that properties of individual computers are successfully eliminated. Our approach is not limited to prefix-free computers, but can be applied to more general sets of computers. The question for what computer sets such stationary distributions exist remains open in general, but is answered in some special cases and is shown to be closely related to the aforementioned symmetry relations.
منابع مشابه
Defining Algorithmic Probability or Complexity in a Machine-Independent Way is Impossible
Kolmogorov complexity and algorithmic probability are defined only up to an additive resp. multiplicative constant, since their actual values depend on the choice of the universal reference computer. In this paper, we analyze a natural approach to eliminate this machine-dependence. Our method is to assign algorithmic probabilities to the different computers themselves, based on the idea that “u...
متن کاملProjected non-stationary simultaneous iterative methods
In this paper, we study Projected non-stationary Simultaneous It-erative Reconstruction Techniques (P-SIRT). Based on algorithmic op-erators, convergence result are adjusted with Opial’s Theorem. The advantages of P-SIRT are demonstrated on examples taken from to-mographic imaging.
متن کاملStructured Chains with Repeated Rows: a Simple Algorithmic Solution
In this paper, we study Markov chains with innnite state block-structured transition matrix with repeated rows and rational structure. We provide an algorithmic approach to nd the stationary probability distribution based on the concepts of linear systems theory. These chains include well-known structured Markov chains such as canonical and non-canonical M/G/1 and G/M/1. We provide a truncation...
متن کاملProbabilistic Sufficiency and Algorithmic Sufficiency from the point of view of Information Theory
Given the importance of Markov chains in information theory, the definition of conditional probability for these random processes can also be defined in terms of mutual information. In this paper, the relationship between the concept of sufficiency and Markov chains from the perspective of information theory and the relationship between probabilistic sufficiency and algorithmic sufficien...
متن کاملON THE STATIONARY PROBABILITY DENSITY FUNCTION OF BILINEAR TIME SERIES MODELS: A NUMERICAL APPROACH
In this paper, we show that the Chapman-Kolmogorov formula could be used as a recursive formula for computing the m-step-ahead conditional density of a Markov bilinear model. The stationary marginal probability density function of the model may be approximated by the m-step-ahead conditional density for sufficiently large m.
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- Theor. Comput. Sci.
دوره 411 شماره
صفحات -
تاریخ انتشار 2010